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The  Relationship  Among  Eye  Movements,  Head  Movements,  and  Manual 
Responses  in  a  Simulated  Air  Traffic  Control  Task 


Performance  in  aviation  systems  requires  a  high 
level  of  visual  attention.  The  ability  of  an  operator 
to  maintain  attention  or  alertness  while  on  position 
(air  traffic  control)  or  during  an  aircraft  flight  (pi¬ 
lot)  can  be  a  critical  factor  in  aviation  safety.  A  study 
was  designed  to  evaluate  several  gaze  measures  as 
possible  indicators  of  changes  in  alertness  of  sub¬ 
jects  who  performed  on  a  visually  demanding  air  traf¬ 
fic  control  (ATC)  simulation  task  (Stern,  Boyer, 
Schroeder,  Touchstone,  and  Stoliarov,  1994).  A  por¬ 
tion  of  the  data  base  from  that  study  was  used  to 
identify  additional  aspects  of  both  eye  and  head 
movements  that  may  be  effected  by  aspects  of  the 
task  itself  and  the  length  of  the  monitoring  session. 

Bizzi,  Kalil  &  Morasso  (1972 )  observed  that  for 
large  amplitude  gaze  shifts,  shifts  accomplished  by 
both  eye  and  head,  eye  movements  generally  pre¬ 
cede  head  movements  by  approximately  30  msec. 
The  head,  however,  tends  to  precede  the  eye  when 
the  target’s  time  and  location  are  predictable.  The 
movements  where  the  head  precedes  the  eye  move¬ 
ment  were  called  “predictive.”  Head  movements  that 
followed  the  eye  movement  were  referred  to  as  “clas¬ 
sical  movements.”  Mourant  and  Grimson  (1977) 
found  that  the  eye  precedes  the  head  by  45  msec  in 
the  classical  eye-head  movement;  under  predictive 
conditions  the  eye  movement  follows  the  head  move¬ 
ment  by  90  msec. 

Zangemeister  and  Stark  (1982)  classified  eye-head 
synchronicities  into  4  types.  Type  1  corresponds  to 
the  classical  movement,  with  the  eye  preceding  the 
head;  about  35%  of  the  time.  Type  I  movements, 
also  referred  to  as  “Synchronous  eye-  and  head-con¬ 
troller  signals,”  are  more  likely  to  occur  when  the 
subject‘s  vigilance  is  low  or  when  the  target’s  bright¬ 
ness  is  high.  Type  I  movements  are  unaffected  by 
the  predictability  of  the  target.  In  the  Type  II  move¬ 
ment,  identified  as  late  head  movements,  the  head 
and  eyes  are  not  synchronized.  The  eye  movement 
occurs  well  before  the  onset  of  the  head  movement 
and  is  usually  not  seen  in  normal  human  subjects. 
The  head  moves  prior  to  the  eye  in  the  Type  III  move¬ 
ments,  also  referred  to  as  early  head  movements. 


Type  III  movements  are  identical  to  Bizzi’ s  predic¬ 
tive  head  movement.  Zangemeister  and  Stark  found 
Type  III  movements  more  likely  to  occur  when  the 
target  location  is  predictable  and  the  subject  is  mak¬ 
ing  a  conscious  effort  to  move  to  the  target  as  rap¬ 
idly  as  possible.  Type  III  movements  occur  43%  of 
the  time.  They  are  also  more  likely  to  occur  when 
the  amplitude  of  the  gaze  shift  is  large.  Type  IV 
movements  are  early  head  movements  with  a  final 
independent  eye  saccade;  they  are  not  synchronous. 

In  the  case  of  Type  IV  movements,  the  head  move¬ 
ment  is  complete  before  the  onset  of  the  saccade. 
These  movements  are  most  likely  to  occur  when  the 
subject  is  required  to  make  a  rapid,  large  amplitude 
gaze  shift. 

There  is  considerable  variation  among  individu¬ 
als  in  both  the  pattern  of  eye-head  movements  and 
in  the  propensity  to  use  the  head  to  acquire  targets 
that  require  a  large  gaze  shift.  Guitton  and  Voile 
(1987)  found  that  the  classical  head  movement  pat¬ 
tern  (Type  I)  is  most  likely  to  occur.  The  latency  of 
the  head  movement  from  the  eye  movement  is  de¬ 
pendent  on  target  predictability;  unpredictable  tar¬ 
gets  have  a  mean  latency  of  42  msec,  while 
predictable  targets  have  a  mean  latency  of  17  msec. 
Some  subjects  demonstrated  a  tendency  for  the  head 
to  precede  the  eye  in  all  conditions.  One  condition 
tested  was  a  self-paced,  unrestrained  head  condition; 

1  subject  was  tested  in  this  condition,  and  the  head 
preceded  the  eye  by  an  average  of  65  msec. 

The  purpose  of  the  present  study  was  to  gather 
data  on  subject  head  movements  and  eye  movements 
made  while  performing  a  demanding  visual  infor¬ 
mation  processing  task.  Analyses  were  conducted  to 
identify  the  presence  of  any  systematic  changes  that 
occurred  in  the  head  and  eye  movements  subjects 
made  between  the  display  and  the  response  keypad.  □ 
Consistent  with  earlier  published  studies,  it  was  □ 
thought  that  head  movements  would  be  predictive;  • 
namely,  that  head  movements  would  precede  eye 

movements  made  to  the  target.  The  location  of  the  . 

target  (the  keypad)  was  known,  although  the  occur¬ 
rence  of  stimuli  requiring  a  response  was  infrequent  3 
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and  unpredictable.  Further,  it  was  thought  that  there 
would  be  a  change  in  the  relationship  between  head 
movements  and  eye  movements,  over  time,  to  corre¬ 
spond  with  the  increased  familiarity  of  the  target 
location.  Changes  in  the  nature  of  the  eye  movement 
were  expected  to  take  place  over  the  course  of  the 
session.  There  were  2  opposing  reasons  for  the  be¬ 
lief  that  a  change  in  the  nature  of  the  eye  movement 
would  occur.  On  the  one  hand,  subjects  might  be 
expected  to  demonstrate  improvements  in  gaze  effi¬ 
ciency  over  time.  On  the  other  hand,  because  the 
task  was  long  (2  hours),  subjects  might  demonstrate 
an  increase  in  gaze  inefficiencies  over  time.  Data 
were  collected  for  each  subject  on  3  occasions,  sepa¬ 
rated  by  approximately  1  week. 

METHODS 

Subjects 

A  subset  of  10  subjects  (9  men  and  1  woman) 
were  chosen  from  a  pool  of  20  subjects  used  in  the 
primary  study  (Stem,  Boyer,  Schroeder,  Touchstone, 
and  Stoliarov,  1994)  on  the  basis  of  their  propensity 
to  make  head  movements.  All  subjects  performed  the 
Thackray-Touchstone  ATC  task  on  3  separate  occa¬ 
sions.  Each  session  lasted  2  hours  and  subjects  were 
paid  for  their  participation. 

Materials 

Display.  Stimuli  were  presented  on  a  19-inch 
graphic  display  terminal  controlled  by  a  VAX  1 1/ 
730  computer.  A  keyboard,  utilized  for  manual  re¬ 
sponses,  was  attached  to  the  lower  right  edge  of  the 
terminal. 

Task.  The  ATC  task  consisted  of  2  lines  of 
nonintersecting  vectors  of  air  traffic,  8  aircraft  each, 
running  from  the  lower  right  to  the  upper  left  of  the 
display.  Subjects  were  required  to  continuously  moni¬ 
tor  these  flight  paths,  which  were  updated  by  quadrant 
every  6  seconds.  The  location  of  an  aircraft  was  de¬ 
noted  by  a  small  rectangle.  Information  about  each  air¬ 
craft,  its  identification  number — altitude  and  ground 
speed  —  were  given  in  an  adjacent  data  box. 

Stimuli.  The  stimuli  were  44  events  that  occurred 
infrequently  throughout  the  2-hour  course  of  the  ses¬ 
sion.  The  minimum  inter-event  time  was  1.5  min¬ 


utes,  and  the  maximum  4  minutes.  There  were  4  event 
types,  each  requiring  the  subject  to  identify  the  event, 
make  a  response,  and  take  action  to  correct  the  situ¬ 
ation.  The  4  event  types  included  2  that  required  1 
response  and  2  that  required  2  responses.  Those 
stimuli  that  required  only  a  single  keyboard  response 
were  the  loss  of  altitude  event  (LOA)  and  the  event 
representing  the  presence  of  an  unidentified  aircraft 
(UAC).  The  other  2  events,  involving  2  aircraft  at 
the  same  altitude,  required  subjects  to  make  the  ini¬ 
tial  identification  response  and  then  further  evalu¬ 
ate  the  nature  of  the  event.  In  the  No  Conflict 
condition,  aircraft  would  be  flying  away  from  each 
other.  In  the  Conflict  condition,  the  aircraft  were  fly¬ 
ing  toward  each  other.  If  the  subject  did  not  identify 
the  event  within  26  seconds,  both  a  visual  and  audi¬ 
tory  alert  occurred.  The  auditory  alert  consisted  of 
a  600  hz,  65  dB  tone  pulsed  at  2  per  second.  The 
visual  alert  was  a  flashing  of  the  2  aircraft  at  the 
same  altitude. 

Procedure 

Subjects  were  prepared  for  the  recording  of  both 
horizontal  and  vertical  electro-oculography  by  at¬ 
taching  AgAgCl  electrodes  on  the  outer  canthi  of 
the  2  eyes  for  the  recording  of  horizontal  eye  move¬ 
ments,  and  above  and  below  the  right  eye  for  the 
recording  of  vertical  eye  movements  and  blinks.  In¬ 
ter-electrode  impedance  was  generally  below  10,000 
ohms.  Signals  were  amplified  with  special  purpose 
amplifiers  with  high  common  mode  rejection.  Am¬ 
plifier  output  was  linear  from  DC  to  100  hz.  The 
output  of  these  amplifiers  was  fed  into  a  Kyowa  data 
logger.  Head  movements  were  recorded  by  placing 
the  inner  liner  from  a  construction  worker’s  helmet 
on  the  subject’s  head.  A  strip  of  balsa  wood  was 
attached  to  the  liner  extending  from  the  back  of  the 
head,  approximately  90  degrees  from  the  subject’s 
shoulders.  At  the  tip  of  the  strip  and  oriented  down¬ 
ward  and  sideways  were  4  LEDs,  2  on  each  side. 
Photocell  receptors  were  attached  to  the  left  and  right 
shoulder.  The  sensors  were  positioned  equidistant 
from  the  light  source,  with  the  subject  looking 
straight  ahead.  The  output  of  the  photocells  was 
appropriately  amplified  and  then  combined  to  allow 
for  the  recording  of  head  movements  in  the  horizontal 


2 


Table  1 .  Frequencies  and  Percentages  of  manual  responses  from  onset  of  head  movements 
within  each  500  msec  time  period  for  Days  1  and  3. 


Before  response  After  response 

0  -  500  ms  501  -  1000  ms  1001  -  1500  ms  1501  -  2000  ms 


Frequency 

% 

Frequency 

% 

Frequency 

% 

Frequency 

% 

Day  1 

4 

1 

115 

33 

176 

51 

50 

15 

Day  3 

13 

5 

162 

55 

95 

32 

24 

8 

plane.  The  output  of  the  head  movement  amplifier 
was  also  fed  into  the  Kyowa  data  logger.  Stimulus 
and  response  data  were  coded  by  assigning  different 
voltage  levels  and  also  recorded  on  the  data  logger. 

The  taped  data  were  digitized  at  200  samples  per 
second.  For  each  of  the  3  test  days  a  1 -minute  sample 
(commencing  at  stimulus  onset)  of  eye-head  move¬ 
ment  data  was  obtained  for  each  of  the  44  infre¬ 
quently  occurring  events. 

Three  types  of  data  events  were  identified;  1)  head 
movements,  the  initiation  and  termination  of  the  head 
movement  made  to  the  target,  2)  horizontal  eye  move¬ 
ments  which  included  the  initiation  of  saccades  made 
to  the  target,  and  the  initiation  of  eye  movements 
that  returned  the  eye  to  the  display  (return  saccades), 
3)  stimuli  and  manual  keyboard  responses.  Head 
movements  and  saccades  were  identified  automati¬ 
cally  by  the  computer  program,  WUPDRS  (Wash¬ 
ington  University  Physiological  Data  Reduction 
System,  Brown,  1990).  Stimulus  and  response  tim¬ 
ing  was  manually  abstracted. 

RESULTS 

The  results  are  organized  to  answer  3  major  ques¬ 
tions:  1)  Are  there  differences  between  the  depen¬ 
dent  measures  in  responding  to  alerted  (cued)  events, 
as  compared  to  events  that  were  responded  to  within 
the  28  seconds  allotted  for  an  uncued  response;  2) 
Are  there  differences  in  the  nature  of  either  to-target 
head  movements  or  eye  movements  over  the  course 


of  the  2  hours;  and  3)  Did  the  nature  of  head  move¬ 
ments  and  eye  movements  differ  from  Day  1  to  Day  3? 

The  dependent  measures  were  1 )  to-target  head 
movements,  2)  to-target  eye  movements,  3)  return 
eye  movements,  and  4)  timing  of  manual  responses. 

Head  movement-manual  response 
relationship 

When  subjects  made  a  gaze  shift  that  included  a 
head  movement,  the  majority  (86%)  of  the  manual 
responses  was  made  between  501  msec  and  1500 
msec  following  that  head  movement.  Table  1  shows 
the  percentages  of  response  latencies  from  the  ini¬ 
tiation  of  the  head  movement  in  each  time  block  for 
both  Day  1  and  Day  3 . 

As  shown  in  Figure  1,  manual  response  latencies 
from  the  onset  of  head  movements  were  significantly 
shorter  on  Day  3  than  on  Day  1  (x^(3)  =  42.01,  p 
<.001). 

This  pattern  of  shorter  response  latencies  on  Day 
3  can  be  seen  across  all  time  periods  and  is  fairly 
consistent  across  time  within  days  as  well,  as  shown 
in  Figure  2.  Seven  of  10  subjects  (4,  13,  16,  17, 21, 
24,  and  25)  showed  this  pattern.  The  remaining  3 
subjects  showed  no  change  from  Day  1  to  Day  3  . 

There  was  no  difference  between  the  pattern  of 
head  movements  for  cued  events  and  uncued  events. 
The  frequency  of  head  movements  did,  however, 
decline  significantly  from  Day  1  to  Day  3  (trq^  = 
2.27,  p  =  .05). 
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Figure  1. 

Percentage  of  to-target 
head  movements  occurring 
in  each  500  msec  time 
biock  for  Day  1  and  Day  3. 


Response  latencies  from  head  movement 


Response  latencies  in  500  msec  blocks 


Figure  2. 

Percentages  of  to-target 
head  movements  initiated  in 
each  500  msec  time  block  for 
Day  1  and  Day  3  (plotted  by 
time).  Time  is  broken  down 
into  early  (the  first  15 
events),  middle  (the  middle 

14  events),  and  late  (the  last 

15  events). 


Response  latencies  from  head  movement 


Response  latencies  in  500  msec  blocks 
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Figure  3. 

Percentage  of  to-tar- 
get  saccades  initiated 
in  each  500  msec  time 
block  for  Day  1  and 
Day  3. 


To  target  sacccades  day  1  and  day  3 


Response  latencies  in  500  msec  blocks 


Table  2.  Frequencies  and  percentages  of  manual  responses  from  initiation  of  eye  movements 
within  each  500  msec  time  period  for  Days  1  and  3. 


0  -  500  ms 

Frequency  % 

Day  1  21  5 

Day  3  7  2 


Time 

501  -  1000  ms  1001  -  1500  ms  1501  -2000  ms 


Frequency 

% 

Frequency 

% 

Frequency 

188 

50 

137 

37 

29 

115 

32 

187 

53 

47 

Saccadic  eye  movement  -  response  rela¬ 
tionship 

The  eye  movement  made  to-target  showed  an  op¬ 
posite  pattern  than  that  of  the  head  movements.  There 
was  a  shift  to  longer  response  latencies,  from  Day  1 
to  Day  3,  as  shown  in  Figure  3.  The  difference  be¬ 
tween  days  in  the  pattern  of  response  latency  from 
the  initiation  of  the  saccade  was  significant 
(x2(3)  =  36.09,  p  <.001. ). 


On  Day  1,  50%  of  responses  were  made  between 
501  msec  and  1000  msec  following  the  eye  move¬ 
ments  made  to  the  target.  On  Day  3,  however,  the 
majority  of  manual  responses  occurred  between  1001 
msec  and  1 500  msec  after  the  eye  began  to  move  to 
the  keypad.  Table  2  shows,  in  frequency  and  per¬ 
centages,  the  latencies  from  eye  movement  initiation 
to  manual  response  within  each  500  msec,  block  for 
both  days. 


Figure  4. 
Percentages  of 
response  laten¬ 
cies  from  to-target 
saccades  initiated 
in  each  500  msec 
time  block  for  Day 
1  and  Day  3,  bro¬ 
ken  down  into  3 
periods:  early  (the 
first  15  events), 
middle  (the  middle 
14  events),  and 
late  (the  last  15 
events). 


Response  latency  from  saccade 


This  pattern  of  eye  movements  and  manual  re¬ 
sponses  was  consistent  across  time  as  well,  as  seen 
in  Figure  4. 

The  pattern  of  eye  movements  to  the  target,  faster 
responses  on  Day  3  than  on  Day  1  following  sac- 
cade  initiation,  was  demonstrated  by  6  out  of  the  10 
subjects  (4,  13, 17,  21,  24,  and  25).  Three  subjects 
(16, 18,  and  3)  demonstrated  no  change  from  Day  1 
to  Day  3.  They  made  the  majority  of  manual  re¬ 
sponses  between  501  msec  and  1000  msec  follow¬ 
ing  the  eye  movement  on  both  Day  1  and  Day  3  . 
Subject  29  was  the  only  subject  having  longer  re¬ 
sponse  latencies  from  saccade  initiation  on  Day  1 
than  on  Day  3. 

As  with  head  movements,  there  was  no  difference 
between  the  cued  or  uncued  events  with  respect  to 


the  eye  movement/manual  response  relationship. 


Coordinated  eye  and  head  movements 
associated  with  gaze  shift  to  the  keyboard. 

If  the  head  movement  consistently  preceded  the 
eye  movement,  the  head  movement  was  considered 
predictive.  If  the  eye  movement  preceded  the  head 
movement,  the  movement  was  considered  a  classi¬ 
cal  movement.  Overall,  46%  of  head  movements 
preceded  eye  movements.  The  percentages  of  eye 
movements  preceding  head  movements  were  fairly 
consistent  over  time  on  Day  1 ,  but  there  was  a  slight 
tendency  for  the  eye  movements  to  precede  the  head 
movements  over  time  on  Day  3,  as  shown  in  Figure  5. 

The  mean  latency  from  the  initiation  of  the  head 
movement  and  initiation  of  the  saccadic  eye  movement 
for  predictive  head  movements  was  longer  on  Day  3 
than  on  Day  1 ;  49  msec  on  Day  1 ,  and  55  msec  on  Day 
3.  The  mean  latency  from  initiation  of  the  eye  move¬ 
ment  and  initiation  of  the  head  movement  for  the  clas¬ 
sical  head  movements  was  longer  on  Day  1  than  on 
Day  3,  59.5  msec  on  Day  1  and  52.5  msec  on  Day  3. 
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Figure  5. 

The  percentages  of  head  movements  that 
precede  the  eye  movements  for  all  subjects 
on  Day  1  and  Day  3. 
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Figure  6. 

The  6  subjects  with  pre¬ 
dictive  head  movements 
on  Day  1  and  Day  3. 


Subjects  with  predictive  head  movements 
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Subjects  with  few  predictive  head  movements 


Figure  7. 

The  4  subjects  with 
few  predictive  head 
movements  on  Day 
1  and  Day  3. 
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For  6  of  the  10  subjects,  head  movements  pre¬ 
ceded  eye  movements  on  at  least  one  day  for  more 
than  50%  of  the  trials  on  which  both  a  head  move¬ 
ment  and  eye  movement  could  be  measured.  As  seen 
in  Figure  6, 5  of  these  6  subjects  showed  a  majority 
of  predictive  head  movements  on  Day  1.  Five  sub¬ 
jects  also  showed  a  majority  of  predictive  head  move¬ 
ments  on  Day  3.  Four  of  the  6  showed  more  than 
50%  predictive  head  movements  on  both  days.  Two 
subjects,  13  and  25,  showed  a  change  in  eye-head 
patterns  from  Day  1  to  Day  3;  subject  25  showed  a 
decline  in  the  percentage  of  predictive  head  move¬ 
ments  from  54%  on  Day  1  to  32%  on  Day  3,  while 
subject  13  showed  an  increase  in  predictive  head 
movements  from  Day  1  (37.5%)  to  Day  3  (58%). 

Subjects  with  few  predictive  head  movements 
showed  less  change  from  Day  1  to  Day  3  than  is 
true  of  those  who  had  a  large  percentage  of  predic¬ 
tive  head  movements  on  Day  1,  as  seen  in  Figure  7. 


Whether  or  not  the  subjects  moved  the  head  first  or 
the  eye  first  appeared  to  be  a  stable  subject  charac¬ 
teristic,  as  seen  in  Figures  6  and  7. 

The  relationship  between  head  and  eye  movements 
did  not  differ  for  cued  and  uncued  events. 

Return  Saccades 

Return  saccades  are  the  eye  movements  that  re¬ 
turned  the  eye  from  the  response  panel  to  the  dis¬ 
play.  This  return  was  necessary  for  the  operator  to 
determine  whether  2  aircraft,  flying  at  the  same  alti¬ 
tude,  were  flying  away  from  or  toward  each  other. 
Overall,  return  saccades  were  more  likely  to  be  made 
prior  to  making  the  manual  response  (80%)  than 
following  the  response.  Table  3  shows  the  frequen¬ 
cies  and  percentages  of  return  saccades  occurring 
on  each  day  for  each  of  the  500  msec  time  periods. 
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Table  3.  Frequencies  and  percentages  of  the  return  saccades  occurring  on  each  day  for  each 
500  msec  time  period. 


Before  response 

After  Response 

1000-501  ms 

500  -  0  ms 

0  -  500  ms 

501  -  1000  ms 

Frequency  % 

Frequency  % 

Frequency  % 

Frequency  % 

Day  1 

32  9 

255  75 

38  11 

14  5 

Day  3 

37  10 

228  65 

63  18 

25  7 

Figure  8. 

The  percentage  of  re¬ 
turn  saccades  in  each 
500  msec  block,  pre¬ 
ceding  and  following 
the  manual  responses 
for  Day  1  and  Day  3. 


Saccade  return  from  response 


Response  latencies  in  500  msec  blocks 


As  seen  in  Figure  8.,  the  pattern  of  the  return  sac¬ 
cades  was  quite  consistent  between  Day  1  and  Day 
3.  All  10  subjects  showed  this  pattern  of  eye  move¬ 
ments,  that  is,  returning  the  eye  to  the  display  prior 
to  making  the  manual  response. 
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Distribution  of  return  saccades 


Figure  9. 

The  percentages  of 
return  saccades  in 
each  500  msec 
block,  preceding 
and  following  the 
manual  response 
for  Day  1  and  Day 
3,  broken  down  into 
3  periods;  early  (the 
first  15  events): 
middle  (the  middle 
14  events),  and  late 
(the  last  15  events). 
Return  saccades  for 
the  first  of  2  re¬ 
sponses  for  conflict/ 
no  conflict  events 
and  for  the  remain¬ 
ing  events  (the  sole 
response). 
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Figure  10. 

The  percentage  of 
return  saccades  in 
each  500  msec 
block  for  the  second 
manual  response. 
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This  pattern  was  consistent  across  time  blocks  on 
both  days  as  well,  as  seen  in  Figure  9. 

There  was  no  difference  in  the  pattern  of  return 
saccades  for  cued  and  uncued  events. 

For  2  of  the  event  types,  conflict  and  no  conflict, 
a  second  response  was  required.  There  were  32  such 
events  where  a  second  return  saccade  could  have 
occurred.  Unlike  the  first  return  saccade,  where  the 
eye  moved  back  to  the  display  before  the  response 
was  made,  the  second  return  saccade  did  not  usually 
occur  prior  to  the  manual  response.  As  shown  in 
Figure.  10,  the  second  return  saccade  followed  the 
response  on  68%  of  events  requiring  a  second  re¬ 
sponse. 

As  seen  in  Figure  11,  the  return  eye  movement 
pattern  was  consistent  from  Day  1  to  Day  3.  Seven 
of  the  10  subjects  showed  the  pattern  of  return  sac- 
cades  following  the  second  manual  response. 


The  2  event  types,  conflict  and  no  conflict,  did 
not  differ  in  overall  second  return  saccade  distribu¬ 
tions,  as  shown  in  Figure  12. 

The  relationship  between  to-target 
saccades  and  return  saccades 

Dwell  time,  the  amount  of  time  the  gaze  is  fixed 
at  the  keypad,  was  derived  by  subtracting  the  target 
saccade  initiation  from  the  return  saccade  initiation. 
The  mean  dwell  time  across  all  subjects  decreased 
from  Day  1  (M=  1040  msec)  to  Day  3  (M=  940 
msec)  by  85  msec.  Six  of  the  10  subjects  showed  a 
decline  in  dwell  time  between  Day  1  and  Day  3  in 
average  keypad  dwell  time.  The  difference,  however, 
was  not  statistically  significant. 


Figure  11. 

The  distribution,  in  percent¬ 
ages,  of  return  saccades  in 
each  500  msec  block  for  the 
Conflict  and  No  Conflict 
events.  Days  1  and  3  are 
combined. 
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Figure  12. 

The  distribution 
of  second  return 
saccades  for  the 
Conflict  and  No 
Conflict  events. 


Conflict  vs  no  conflict  events  all  days 
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DISCUSSION 

Cued  vs.  Noncued  Events 

No  differences  were  found  between  cued  and 
uncued  events  for  any  of  the  measures.  Our  results 
suggest  that  regardless  of  whether  the  subject  de¬ 
tects  the  unusual  event  or  is  alerted  to  its  presence, 
eye  movement  and  head  movement  patterns  to  the 
response  pad  are  indistinguishable.  One  possible 
reason  for  this  unexpected  lack  of  difference  may  be 
that  all  events  are  “cued”  events  in  the  sense  that  the 
subject  is  alerted  to  their  presence  on  the  display.  It 
apparently  makes  no  difference  whether  the  opera¬ 
tor  identifies  the  event,  or  whether  it  is  done  by  a 
visual  warning  plus  an  auditory  warning  signal.  Once 
the  event  is  identified  by,  or  for,  the  operator,  the 
sequence  of  events  leading  to  the  manual  response 
is  the  same. 

Time  on  task  effects 

Time-on-task  (TOT)  effects  are  reflected  in 
changes  across  days  (between  days)  and  across  time 
during  each  session  (within  days).  The  first  and  third 


day  were  chosen  for  the  analysis  of  between  days 
effects.  On  each  day,  the  2-hour  session  was  divided 
into  3  blocks  representing  early,  middle,  and  late 
occurring  events.  We  had  expected,  over  the  course 
of  the  task,  decreases  in  gaze  efficiency  that  would 
manifest  themselves  as  changes  in  either  eye-head 
coordination  or  increased  response  latencies  and 
longer  fixation  periods  (keypad  dwell  time). 

To  determine  if  TOT  differences  in  gaze  shifts 
strategies  occur,  it  is  important  to  look  at  the  com¬ 
ponents  of  the  response.  The  response  required  in 
our  task  consisted  of  3  segments.  The  first  was  vi¬ 
sual  acquisition,  the  second  was  to  move  the  eye  to 
the  keypad,  and  the  third  was  to  identify  the  appro¬ 
priate  key  and  make  the  manual  response.  The  TOT 
findings  for  between  days  and  across  time  within 
days  will  be  discussed  separately. 

Within  days.  There  did  not  appear  to  be  any  sig¬ 
nificant  TOT  effect  for  head  movement  or  saccade 
initiation.  Within  days  the  response  latencies  for  eye 
and  head  movement  initiations  were  quite  consistent. 
Between  days,  however,  there  were  a  number  of 
differences. 
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Between  Days.  There  was  a  shift  toward  shorter 
response  latencies  on  Day  3  than  are  found  on  Day 
1  for  head  movements,  but  the  opposite  was  true  for 
the  eye  movements.  For  head  movements,  we  found 
3  changes  between  days;  1)  there  were  fewer  head 
movements  made  to  acquire  the  target  on  Day  3  than 
were  made  on  Day  1 ;  2)  the  percentage  of  head  move¬ 
ments  preceding  the  eye  movement  decreased  only 
slightly  from  Day  1  to  Day  3;  and  3)  response  laten¬ 
cies  from  the  initiation  of  the  head  movement  were 
shorter  on  Day  3  than  on  Day  1 .  There  was  1  related 
finding  for  gaze  shift  over  the  2  days.  The  average 
keypad  dwell  time  declined  from  Day  1  to  Day  3  by 
85  ms,  although  this  was  not  statistically  signifi¬ 
cant.  One  possible  reason  for  these  changes  is  that 
by  Day  3,  subjects  were  likely  to  have  become  much 
more  familiar  with  the  task  and  required  less  time  to 
complete  the  third  segment  of  the  response;  these  4 
related  changes  from  Day  1  to  Day  3  point  to  a  pos¬ 
sible  change  in  scanning  strategy  on  Day  3. 

There  are  2  assumptions  that  follow  from  in¬ 
creased  gaze  efficiencies  on  Day  3.  First,  if  head 
movements  are  more  likely  to  occur  when  the  sub¬ 
ject  knows  that  gaze  has  to  be  held  at  the  keypad  for 
an  extended  period  of  time,  it  follows  that  there  might 
be  fewer  head  movements  on  Day  3  than  on  Day  1 . 
This  decrease  is  likely  because  as  subjects  become 
more  familiar  with  the  response  procedure,  they  re¬ 
quire  less  time  to  find  the  appropriate  keys.  Second, 
the  percentage  of  predictive  head  movements  should 
increase  from  Day  1  to  Day  3.  If  dwell  time  decreased 
over  time,  it  should  follow  that  as  the  location  and 
function  of  the  keypad  becomes  more  familiar  to  the 
subject,  it  is  more  predictable.  It  is  usually  found 
that  if  the  gaze  shift  is  made  to  a  predictable  loca¬ 
tion,  the  head  precedes  the  eye.  This  decrease  is  not 
what  happened  for  the  majority  of  our  subjects.  We 
found  the  relationship  between  head  movements  and 
eye  movements  to  be  consistent  between  days. 

We  believe  that  2  distinctive  factors  affected  the 
likelihood  of  eye-head  movements;  1)  individual  dif¬ 
ferences,  and  2)  the  cognitive  processing  demands 
of  the  task.  There  were  2  distinct  groups  of  sub¬ 
jects,  1  with  a  fairly  high  level  of  predictive  head 
movements,  and  the  other  with  a  fairly  low  percent¬ 
age  of  predictive  head  movements.  Subject  variabil¬ 


ity,  such  as  we  have  found  in  the  present  study,  was 
consistent  with  Guitton  and  Voile  (1987)  who  noted 
subject  differences  in  predictive  head  movements. 
Likewise,  Funk  and  Anderson  (1977)  observed  con¬ 
siderable  eye-head  movement  variability  in  children. 
They  report  only  1  of  9  subjects  had  a  pattern  of  eye 
movements  that  could  be  considered  classical,  while 
the  others  showed  a  predictive  pattern.  They  also 
reported  a  wide  variation  in  the  latency  between  head 
movement  and  eye  movement  onset.  Funk  and  Ander¬ 
son  attributed  this  large  variability  to  “a  lack  of 
structured  motivational  forces  and  a  lack  of  famil¬ 
iarity  with  the  equipment  and  the  test  situation”  (p. 
608).  Our  results  do  not  support  this  explanation. 
There  is  considerable  variability  among  subjects 
within  days  for  both  the  latency  between  the  initia¬ 
tion  of  the  eye  movements  and  the  initiation  of  head 
movements.  Between  days,  however,  subjects  are 
internally  consistent  in  their  overall  pattern  of  coor¬ 
dinated  eye-head  movements.  The  subjects  in  our 
study  had  4  hours  of  practice  with  the  ATC  task  by 
the  beginning  of  Day  3  and  they,  for  the  most  part, 
displayed  a  pattern  of  coordinated  eye-head  move¬ 
ment  patterns  on  Day  3  that  was  consistent  with  their 
eye-head  movement  pattern  on  Day  1 .  Additionally, 
the  movement  of  the  eye  back  to  the  display  prior  to 
the  first  response  and  the  movement  of  the  eye  back 
to  the  display  following  the  second  response  for  the 
Conflict/No  Conflict  events  provides  evidence  for 
highly  motivated  responding.  If  the  subjects  were 
not  concerned  with  rapid  and  accurate  performance, 
it  is  unlikely  that  the  present  pattern  of  responding 
would  be  found.  If  subjects  were  not  motivated  to 
move  as  rapidly  as  possible  to  collect  the  second 
piece  of  information  necessary  for  the  decision  pro¬ 
cess  in  the  Conflict/No  Conflict  condition,  it  is  likely 
that  the  return  saccades  would  have  followed,  rather 
than  preceded,  manual  response  initiation  as  they 
did  in  the  first  response. 

Bizzi  ( 1 974)  noted  that  “motor  output  subserving 
the  coordinated  output  of  eye-head  movements  is  not 
fixed,  but  instead  exhibits  distinctive  patterns  de¬ 
pending  on  the  specific  behavioral  situation”  (p  105). 
These  behavioral  situations  may  account  for  the  dif¬ 
ferences  between  movements  to  memorized  locations 
in  both  monkeys  (Bizzi,  Kalil  and  Morasso,  1972) 
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and  cats  (Guitton  and  Voile,  1987).  There  were  also 
differences  found  in  children  among  the  3  variations  of 
Funk  and  Anderson’s  (1977)  task.  Dunham  (1992) 
found  differences  in  the  likelihood  of  head  movements 
in  subjects  performing  either  a  mathematical  task  or  a 
counting  task.  When  the  cognitive  demand  was  low, 
i.e.,  the  counting  task,  the  subjects  were  less  likely  to 
move  their  heads  than  when  the  task  was  difficult,  i.e., 
the  math  task.  Rahimi,  Briggs,  and  Thom  (1990) 
found  that  when  the  driving  situation  was  more  de¬ 
manding,  for  example,  in  a  busy  intersection,  driv¬ 
ers  made  more  head  movements  than  when  the 
situation  was  less  demanding  (a  quiet  intersection). 
According  to  Rahimi,  Briggs,  and  Thom  (1990),  head 
turning  is  desirable  when  the  amount  of  information 
to  be  abstracted  from  the  scene  is  great.  It  appears 
the  gaze  system  is  under  considerable  voluntary  con¬ 
trol  when  the  task  demands  greater  attention  be  paid 
to  the  visual  scene  for  the  abstraction  or  the  pro¬ 
cessing  of  information . 


Return  Saccades 

The  most  reliable  finding  was  that  the  eye  move¬ 
ments  returning  gaze  to  the  display  were  sensitive  to 
task  demands.  When  making  the  first  of  2  responses, 
the  eye  returns  to  the  display  prior  to  making  the  manual 
response  80%  of  the  time.  In  the  32  events  that  re¬ 
quired  a  second  response,  additional  information  had 
to  be  abstracted  from  the  display  to  make  the  second 
response.  It  was,  therefore,  important  to  shift  gaze 
quickly.  This  task  demand  was  reflected  in  the  pattern 
of  eye  movements.  The  quick  return  of  the  eye  to  the 
display  in  this  case  differed  from  that  of  the  second 
manual  response  where,  after  making  the  second 
manual  response,  no  further  visual  information  was 
required.  The  eyes  returned  to  the  display  after  mak¬ 
ing  the  manual  response.  Subjects  on  days  2  and  3  knew 
the  next  unusual  event  would  not  occur  for  some  time, 
consequently,  their  eyes  did  not  return  to  the  display 
until  after  the  response  was  made  on  68%  of  such 
events.  Figure  1 3  shows  the  difference  between  the  re¬ 
turn  saccades  associated  with  the  first  response  and 
the  return  saccades  associated  with  the  second  response. 


Figure  13. 

The  distribution,  in 
percentages,  of  the 
first  return  saccade 
and  second  return 
saccade  for  the  Con- 
fiict  and  No  confiict 
events  combined. 
Days  1  and  3  are 
combined. 


Response  1  and  response  2  for 
conflict  and  no  conflict  event 
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Due  to  the  complex  nature  of  the  response  required 
in  our  task,  measured  from  stimulus  onset  to  manual 
response,  there  was  an  inadequate  measure  of  effi¬ 
ciency.  Because  the  subject  must  scan  2  vectors  of 
air  traffic;  finding  the  “event”  depended,  not  only 
on  their  level  of  alertness,  but  where  they  are  look¬ 
ing  when  the  “event”  presented  itself.  Mackworth  & 
Kaplan  (1964)  found  that  the  more  elements  one  must 
monitor,  the  more  likely  an  infrequently  occurring 
event  will  be  missed.  Interestingly,  Mackworth  and 
Kaplan  found  about  40%  of  the  two-dial  targets  were 
fully  fixated  when  they  were  missed;  subjects  were 
often  “looking”  at  the  event  when  they  failed  to  de¬ 
tect  it.  The  task  required  of  subjects  in  our  study 
was  more  complex  than  Mackworth  and  Kaplan’s 
simple  detection  task,  therefore,  subjects  would  be 
expected  to  “miss”  even  more  of  the  infrequently 
occurring  events.  Thackray  «fc  Touchstone  (1989) 
found  the  ability  to  detect  targets  in  a  more  complex 
environment  manifested  itself,  not  only  as  an  increase 
in  detection  time,  but  also  as  increased  errors.  Er¬ 
rors,  in  their  study,  included  missed  signals  (as  in 
our  study)  and  also  incorrect  decision  responses  con¬ 
cerning  the  event  types.  They  concluded  that  the 
additional  demands  of  a  decision  regarding  the  di¬ 
rection  of  flight  in  the  Conflict/No  Conflict  events 
added  to  the  complexity  of  an  already  demanding 
visual  environment,  resulting  in  more  errors  and 
longer  reaction  times  over  the  course  of  the  session. 
They  found  no  such  increase  for  less  demanding 
tasks,  tasks  which  only  required  a  single  keyboard 
response,  such  as  an  unidentified  aircraft  entering 
the  air  space  (UAC)  or  loss  of  altitude  warnings 
(LOA)  events.  The  first  return  saccades  for  these 
less-demanding  tasks  (UACs  and  LOAs)  were  simi¬ 
lar  to  the  first  response  for  the  Conflict/  No  Con¬ 
flict  events:  they  required  only  an  identification.  The 
second  response  for  the  Conflict/No  Conflict  events, 
in  addition  to  the  identification,  required  the  subject 
to  make  a  decision.  Therefore,  additional  informa¬ 
tion  needed  to  be  gathered,  processed,  and  a  gaze 
shift  back  to  the  keypad  had  to  be  made.  This  pro¬ 
cess  required  a  quick  return  to  the  display  following 
identification  of  the  event,  which  is  not  present  in 


the  less  demanding  task  of  merely  identifying.  The 
second  return  saccade  for  the  Conflict/No  Conflict 
events,  on  the  other  hand,  was  much  more  like  that 
of  the  first  response  in  the  less  demanding  events. 
Because  the  subject  was  not  required  to  abstract  any 
additional  information,  he  could  return  to  the  dis¬ 
play  with  little  time  pressure. 

Eye-Head  Coordination 

The  coordination  of  the  target  to  eye-head  move¬ 
ments  was  found  to  be  consistent  with  previous  stud¬ 
ies,  both  in  frequency  and  variability  of  predictive 
and  classical  movements.  There  may  be  consistent 
individual  differences  in  the  eye-head  movement 
patterns  employed  by  subjects  to  shift  their  gaze  to 
the  keypad  before  making  a  manual  response.  Four 
subjects  demonstrated  consistent  predictive  eye-head 
movement  patterns,  and  another  group  of  4  demon¬ 
strated  consistent  classical  eye-head  movement  pat¬ 
terns.  It  was  impossible  for  subjects  to  know  which 
events  would  require  additional  processing,  so  the 
initial  eye-head  movements  are  the  same  for  all  4 
event  types.  Because  there  is  no  difference  in  the 
first  response,  it  is  difficult  to  determine  if  the  diffi¬ 
culty  of  the  task  influences  the  eye-head  movement 
pattern.  The  easier  event  types,  LOA  and  UAC,  re¬ 
quired  only  1  manual  response,  so  no  comparison 
can  be  made  between  easy  and  difficult  event  types. 
There  were  also  fewer  of  these  events  in  the  task, 
only  8  LOAs  and  4  UACs.  If  all  events  required  a 
second  response,  it  would  be  possible  to  compare 
easy  and  difficult  event  types  for  the  second  re¬ 
sponses. 

We  suggest  that  head  movements  are  a  likely  in¬ 
dicator  of  processing  demand.  In  other  words,  sub¬ 
jects  making  large  numbers  of  head  movements  find 
the  task  to  demand  more  cognitive  effort.  Analyses 
of  the  1 0  subjects  (Stern,  Boyer,  Schroeder,  Touch¬ 
stone,  and  Stoliarov,  1994)  who  did  not  make  head 
movements  to  acquire  the  keypad  target  could  pro¬ 
vide  comparison  data  that  would  provide  additional 
evidence  regarding  the  relationship  between  task 
demands  and  head  movements. 


15 


REFERENCES 

Bizzi,  E.  (1974).  The  coordination  of  eye-head  move¬ 
ments.  Scientific  American,  231(4),  100-106. 

Bizzi,  E.,  Kalil,  R.  E.  &  Morasso,  P.  (1972).  Two 
modes  of  active  eye-head  coordination  in  monkeys. 
Brain  Research,  40, 45  -  48. 

Brown,  T.  B.  (1990).  Washington  University  Physi¬ 
ological  Data  Reduction  System  [Computer  pro¬ 
gram].  St.  Louis,  MO:  Washington  University 
Behavior  Research  Lab. 

Douglas,  R.  M.,  Guitton,  D.  &  Voile,  M.  (1982).  Co¬ 
ordinated  eye-head  movements  in  the  cat.  In  A. 
Roucouex  &  M.  Crommelinck  (fi<3iS.)  Physiologi¬ 
cal  and  pathological  aspects  of  eye  movements. 
Dr.  W.  Junk  Publishers:  The  Hague. 

Dunham,  D.  N.  (1992).  The  relationship  between  task 
difficulty  and  the  likelihood  of  head  movement. 
Washington  University  in  St.  Louis.  Dissertation 
Abstracts  International,  1128B. 

Funk,  D.  J.  &  Anderson,  M.  E.  (1977).  Saccadic  eye 
movements  and  eye-head  coordination  in  children. 
Perceptual  and  Motor  Skills,  44,  599-6 10. 

Gresty,  M.  (1974).  Coordinated  and  Eye  movements 
to  fixate  continuous  and  intermittent  targets.  Vi¬ 
sion  Research,  14,  395-403. 

Guitton,  D.  &  Voile,  M.  (1987).  Gaze  control  in  hu¬ 
mans:  eye-head  coordination  during  orienting 
movements  to  targets  within  and  beyond  the  ocu¬ 
lomotor  range.  Journal  of  Neurophysiology,  58, 
All  -  459. 


Mackworth,  N.  H.  &  Kaplan,  1. 1.  (1964).  Eye  move¬ 
ment  during  vigilance.  Perceptual  Motor  Skills, 
18,  397-402. 

Mourant,  R.  R.  &  Grimson,  C.  G.  (1977).  Predictive 
head-movements  during  automobile  mirror  sam¬ 
pling.  Perceptual  and  Motor  Skills,  44, 283-286. 

Munoz,  D.  P.,  Pellison,  D.  &  Guitton,  D.  ( 1 99 1 ).  Move¬ 
ments  of  neural  activity  on  the  superior  colliculus 
motor  map  during  gaze  shifts.  Science,  251, 1358 
-  1360. 

Rahimi,  M,  Briggs,  R.  P.  &  Thom,  D.  R.  (1990).  A 
field  evaluation  of  driver  eye  and  head  movements 
strategies  toward  environmental  targets  and 
distr&ctoxs.  Applied  Ergonomics,  21(4),  267-274. 

Sparks,  D.  L.  (1991).  The  neural  control  of  orienting 
eye  and  head  movements.  In  Motor  control:  con¬ 
cepts  and  issues.  D.  R  Humphreys  and  H.  J.  Freund 
(Eds.)  John  Wiley:  NY. 

Stem,  J.A.,  Boyer,  D.,  Schroeder,  D.,  Touchstone,  M., 
and  Stoliarov,  N.  (1994).  Blinks,  saccades  and 
fixation  pauses  during  vigilance  performance  1: 
Time-on-task  effects.  Technical  Report  DOT/FAA/ 
AM  94-26.  Washington,  DC:  U.S.  Department  of 
Transportation,  Federal  Aviation  Administration, 
Office  of  Aviation  Medicine. 

Thackray,  R.  I.  &  Touchstone,  R.  M.  (1989  ).  Effect 
of  high  visual  taskload  on  the  behaviors  involved 
in  complex  monitoring.  jErgowo/w/ci,  32(1),  27-36. 

Zangemeister,  W.  H.  &  Stark,  L.  (1982).  Types  of  gaze 
movements:  Variable  interactions  of  eye  and  head 
movements.  Experimental  Neurology,  77, 563-577. 


16 


GOVERNMENT  PRINTING  OFFICE:  1995  -  5504)67/20020 


